PORTABLE ELECTRONIC DEVICE WITH MOUSE-LIKE 
CAPABILITIES 
Reference to Related Patents 

This Application is related to the subject matter described in the 
5 following U.S. patents: U.S. Patent No. 5,578,813, filed March 2, 1995, issued 
November 26, 1996, and entitled FREEHAND IMAGE SCANNING DEVICE 
WHICH COMPENSATES FOR NON-LINEAR MOVEMENT; U.S. Patent No. 
5,644,139, filed August 14, 1996, issued July 1, 1997, and entitled 
NAVIGATION TECHNIQUE FOR DETECTING MOVEMENT OF 

1 0 NAVIGATION SENSORS RELATIVE TO AN OBJECT; and U.S. Patent No. 
5,786,804, filed October 6, 1995, issued July 28, 1998, and entitled METHOD 
AND SYSTEM FOR TRACKING ATTITUDE. These three patents describe 
techniques of tracking position movement. Those techniques are a component in 
a preferred embodiment described below. Accordingly, U.S. Pat. Nos. 

15 5,578,813, 5,644,139, and 5,786,804 are hereby incorporated herein by 
reference. 

This application is also related to the subject matter described in U.S. 
Patent No. 6,057,540, filed April 30, 1998, issued May 2, 2000, and entitled 
MOUSELESS OPTICAL AND POSITION TRANSLATION TYPE SCREEN 

20 POINTER CONTROL FOR A COMPUTER SYSTEM; U.S. Patent No. 

6,151,015, filed April 27, 1998, issued November 21, 2000, and entitled PEN 
LIKE COMPUTER POINTING DEVICE; and U.S. patent application Ser. No. 
09/052,046, filed March 30, 1998, entitled SEEING EYE MOUSE FOR A 
COMPUTER SYSTEM. These two related patents and patent application 

25 describe screen pointing devices based on the techniques described in U.S. Pat. 
Nos. 5,578,813, 5,644,139, and 5,786,804. Therefore, U.S. Patent Nos. 
6,057,540 and 6,151,015, and U.S. patent application Ser. No. 09/052,046, filed 
March 30, 1998, entitled SEEING EYE MOUSE FOR A COMPUTER 
SYSTEM, are hereby incorporated herein by reference. 

30 

The Field of the Invention 

This invention relates generally to portable electronic devices. This 
invention relates more particularly to a portable electronic device with mouse- 
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like capabilities for controlling a pointer on a display screen of the electronic 
device. 

Background of the Invention 

5 The use of a hand operated pointing device for use with a computer and 

its display has become almost universal. By far the most popular of the various 
devices is the conventional (mechanical) mouse, used in conjunction with a 
cooperating mouse pad. Centrally located within the bottom surface of the 
mouse is a hole through which a portion of the underside of a rubber- surfaced 

1 0 steel ball extends. The mouse pad is typically a closed cell foam rubber pad 
covered with a suitable fabric. Low friction pads on the bottom surface of the 
mouse slide easily over the fabric, but the rubber ball does not skid. Rather, the 
rubber ball rolls over the fabric as the mouse is moved. Interior to the mouse are 
rollers, or wheels, that contact the ball at its equator and convert its rotation into 

1 5 electrical signals representing orthogonal components of mouse motion. These 
electrical signals are coupled to a computer, where software responds to the 
signals to change by a AX and a AY the displayed position of a pointer (cursor) 
in accordance with movement of the mouse. The user moves the mouse as 
necessary to get the displayed pointer to a desired location or position. Once the 

20 pointer on the screen points at an object or location of interest, a button on the 
mouse is activated with the fingers of the hand holding the mouse. The 
activation serves as an instruction to take some action, the nature of which is 
defined by software in the computer. 

In addition to mechanical types of pointing devices like a conventional 

25 mouse, optical pointing devices have also been developed, such as those 

described in the incorporated patents and patent application. In one form of an 
optical pointing device, rather than using a moving mechanical element like a 
ball in a conventional mouse, relative movement between an imaging surface, 
such as a finger or a desktop, and photo detectors within the optical pointing 

30 device, is optically sensed and converted into movement information. 
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For portable electronic devices, such as cellular telephones, personal 
digital assistants (PDAs), digital cameras, portable game devices, pagers, 
portable music players (e.g., MP3 players), and other devices, it maybe 
undesirable to use an external pointing device, such as a mechanical mouse or an 
5 optical mouse, coupled to the device. It is often inconvenient to carry around the 
additional equipment. And with a mechanical pointing device Hke a mouse, it 
may be difficult to find a suitable surface on which to operate the mouse. 

Some portable electronic devices include built-in screen pointing devices. 
For example, some cellular telephones include arrow keys that allow a highlight 

10 bar to be moved around on a display screen to highlight menu items, such as 

names or telephone numbers. Once a menu item has been highlighted, the menu 
item is typically selected by pressing another key on the cellular telephone. 
Using multiple arrow keys to highlight and select menu items is inefficient and 
time consuming, particularly for users who are more familiar with operating 

1 5 other types of screen pointing devices, such as a mouse or trackball, or an optical 
pointing device. 

It would be desirable to essentially turn a portable electronic device into 
a mouse. By providing mouse-like capabilities to a portable electronic device, 
the device could be operated in a manner similar to a conventional mouse, but 
20 without the inconvenience of carrying around additional equipment. It would 
also be desirable to incorporate security features into the electronic device, so 
that certain patterns of movement of the electronic device could be detected, and 
used to identify or verify a particular user. 

25 Summary of the Invention 

One form of the present invention provides a method of controlling menu 
item selection in a portable electronic device. The portable electronic device 
includes a menu display having a plurality of menu items and a menu item 
pointer movable by a user to highlight particular menu items. Relative 
30 movement between the portable electronic device and an imaging surface is 
sensed. A first set of movement data is generated indicating a first relative 
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movement between the portable electronic device and the imaging surface. The 
menu item pointer is moved based on the first set of movement data to highlight 
a first menu item. A second set of movement data is generated indicating a 

second relative movement between the portable electronic device and the 
5 imaging surface. The first menu item is selected based on the second set of 
movement data. 

Another form of the present invention provides a portable electronic 
device including a menu display having a plurality of menu items, and a menu 
item pointer movable by a user to highlight particular menu items. The portable 
electronic device includes a motion sensor for sensing relative movement 
between the portable electronic device and an imaging surface. The motion 
sensor is configured to generate a first set of movement data indicating a first 
relative movement between the portable electronic device and the imaging 
surface. The motion sensor is configured to generate a second set of movement 
data indicating a second relative movement between the portable electronic 
device and the imaging surface. A controller is configured to move the menu 
item pointer based on the first set of movement data to highlight a first menu 
item. The controller is configured to select the first menu item based on the 
second set of movement data. 

Another form of the present invention provides a method of identifying 
the user of a portable electronic device. Movement pattern data representing a 
first pattern of relative movement between the portable electronic device and an 

1 0 imaging surface is stored. Relative movement between the portable electronic 
device and an imaging surface is sensed. A first set of motion data is generated 
based on the sensed relative movement. The first set of motion data represents a 
second pattern of relative movement between the portable electronic device and 
an imaging surface. The first set of motion data is compared to the stored 

1 5 movement pattern data. The user of the portable electronic device is identified 
based on the comparison of the first set of motion data to the stored movement 
pattern data. 
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Another form of the present invention provides a portable electronic 
device having a capability to identify a current user of the device. The device 
includes a memory for storing movement pattern data representing a first pattern 
of relative movement between the portable electronic device and an imaging 
5 surface. A motion sensor generates a first set of motion data representing a 
second pattern of relative movement between the portable electronic device and 
an imaging surface. A controller compares the first set of motion data to the 
stored movement pattern data. The controller is configured to identify the user 
of the portable electronic based on the comparison of the first set of motion data 

10 to the stored movement pattern data. 

Another form of the present invention provides a portable electronic 
device including a memory for storing movement pattern data representing a first 
pattern of relative movement between the portable electronic device and an 
imaging surface. A motion detector generates a first set of motion data 

1 5 representing a second pattern of relative movement between the portable 

electronic device and an imaging surface. A controller compares the first set of 
motion data to the stored movement pattern data. The controller is configured to 
enable operation of the portable electronic device if the first set of motion data 
matches the stored movement pattern data. 



20 Brief Description of the Drawings 

Figure 1 A is a perspective view of one embodiment of cellular telephone 
with an optical, motion translation type screen pointer device positioned on a 
front side of the telephone. 

Figure IB is a perspective view of an alternative embodiment of a 
25 cellular telephone including an optical, motion translation type screen pointer 
device positioned on a back side of the telephone. 

Figure 2 is a pictographic side view of the main components of one 
embodiment of an optical, motion translation type screen pointer device 
according to the present invention. 
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Figure 3 is an electrical block diagram of major components of the 
cellular telephones shown in Figures 1 and 2. 

Description of the Preferred Embodiments 

5 In the following detailed description of the preferred embodiments, 

reference is made to the accompanying drawings, which form a part hereof, and 
in which is shown by way of illustration specific embodiments in which the 
invention may be practiced. It is to be understood that other embodiments may 
be utilized and structural or logical changes may be made without departing 

10 from the scope of the present invention. The following detailed description, 
therefore, is not to be taken in a limiting sense, and the scope of the present 
invention is defined by the appended claims. 

Figure 1 A is a perspective view illustrating a front surface of a portable 
electronic device according to one embodiment of the present invention. In the 

1 5 embodiment shown in Figure 1 A, portable electronic device 1 OA is a cellular 
telephone. In an alternative embodiment, device 1 OA may be any type of 
portable electronic device having a display screen, including a personal digital 
assistant (PDA), digital camera, portable game device, pager, portable music 
player, or other device. When referring to a particular portable electronic device 

20 herein, the reference numeral "1 0" with an appended letter is used. When 

referring generally to portable electronic devices according to embodiments of 
the present invention, the reference number "10" with no appended letter is used. 

Cellular telephone lOA includes power button 12, display screen 14, 
highlight bar 16, menu items 18A-18C (collectively referred to as menu 18), 

25 motion detection device 20, and a plurality of pushbuttons 24. Pushbuttons 24 
are also referred to as keypad 24. A user turns cellular telephone lOA on/off 
using power button 12. A menu 18, including a pluraHty of menu items 18A- 
18C, is displayed to a user on display screen 14. In one embodiment, menu 
items 1 8A- 1 8C are names or phone numbers. For menu items 1 8 A- 1 8C that are 

30 names, cellular telephone lOA stores an associated telephone number for each 
such name. 
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A user highlights a particular one of the menu items 1 8A-1 8C by moving 
highlight bar 16. In one embodiment, highlight bar 16 is moved by rubbing 
finger 22 against motion detection device 20. If finger 22 is moved upward 
against motion detection device 20, highlight bar 16 moves upward through 
5 menu items 1 8A-1 8C. If finger 22 is moved downward against motion detection 
device 20, highlight bar 16 moves downward through menu items 18A-1 8C. 
After a desired one of the menu items 18A-18C has been highlighted with 
highlight bar 16, the highhghted menu item is then selected. In one 
embodiment, a highlighted menu item is selected by moving finger 22 against 
1 0 motion detection device 20 in either a leftward or rightward direction. After a 
highlighted menu item has been selected by a user, cellular telephone 1 OA 

automatically dials the selected phone number, or the phone number associated 
with the selected name. 

In one embodiment, an alternative technique is used to select highlighted 

15 menu items, such as pushing a button on keypad 24 or tapping on motion 
detection device 20. However, when a user removes finger 22 fi-om motion 
detection device 20 to push one of pushbuttons 24 or tap on motion detection 
device 20, the user may accidentally cause additional movement across motion 
detection device 20, thereby causing a different menu item to be selected. By 

20 selecting menu items 1 8A- 1 8C with rightward or leftward movement across 
motion detection device 20, the user need not remove the user's finger 22 from 
motion detection device 20 to select a desired menu item, which allows the user 
to select desired menu items more quickly and accurately. 

The present invention is not limited to using upward and downward 

25 motion to liighlight menu items, and using leftward and rightward motion to 
select menu items. Rather, the techniques described herein may be adapted to 
any type of menu system. For example, in one embodiment, after highlighting a 
menu item, a leftward motion causes one action to be taken, such as dialing the 
phone number, and a rightward motion causes a different action to be taken, such 

30 as allowing the user to edit the phone number or name. Velocity, acceleration 
and repetition of motion of finger 22 against motion detection device 20 is also 
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taken into account in one form of the present invention to expand the number of 
actions that can be invoked. Further, for a menu system that provides leftward 
and rightward scrolHng, leftward and rightward motion across motion detection 
device 20 would cause menu items to be highlighted, and upward or downward 
5 motion across motion detection device 20 would cause highlighted menu items 
to be selected. It will also be understood that other types of screen pointers may 
be used rather than a highlight bar 16, such as an arrow or other movable 
indicator. 

Figure 1 B is a perspective view illustrating a back surface of an 
10 alternative embodiment of the portable electronic device shown in Figure 1 A. 
Cellular telephone lOB shown in Figure IB is substantially the same as cellular 
telephone lOA shown in Figure 1 A, with the exception that motion detection 
device 20 is positioned on a back surface of cellular telephone lOB, whereas 
motion detection device 20 is positioned on a front surface of cellular telephone 
15 1 OA. By positioning motion detection device 20 on a back surface of cellular 
telephone lOB, cellular telephone lOB may be operated in a manner similar to a 
conventional mouse. Cellular telephone 1 OB may nibbed against a work surface 
or an imaging surface, such as a desktop, pants leg, a wall, or any other relatively 
flat surface, to highlight and select particular menu items 1 8A-1 8C. Motion 
20 detection device 20 may also be operated as described with reference to Figure 
1 A, such as by sliding the user's hand or finger across motion detection device 
20. 

It will be understood that multiple motion detection devices 20 may be 
used in a portable electronic device 10. In one embodiment, a motion detection 

25 device 20 is positioned on both a front and a back surface of a portable elecfronic 
device 10, to allow a user the option of using a finger to control menu item 
selection, or using the device 10 itself to confrol menu item selection. It will 
also be understood that it is the relative motion between motion detection device 
20 and a work surface or imaging surface that generates movement of highlight 

30 bar 1 6, and that such movement may be generated either by moving a surface 
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relative to motion detection device 20, or by moving motion detection device 20 
relative to a surface. 

In one embodiment, if motion detection device 20 of cellular telephone 
lOB is moved upward against a work surface, highlight bar 16 moves upward 
5 through menu items 1 8A- 1 8C. If motion detection device 20 is moved 

downward against a work surface, highlight bar 16 moves downward through 
menu items 1 8A- 1 8C. After a desired one of the menu items 1 8A-1 8C has been 
highlighted with highlight bar 16, the highlighted menu item is then selected. In 
one embodiment, a highUghted menu item is selected by moving motion 

10 detection device 20 against a work surface in either a leftward or rightward 
direction. After a highlighted menu item has been selected by a user, cellular 
telephone 1 OA automatically dials the selected phone number, or the phone 
number associated with the selected name. 

In one form of the present invention, portable electronic device 10 

1 5 includes a security feature that requires a user to enter a "gestural password" 

before using the device 10. A gestural password is similar to textual passwords, 
which are typically used in computer systems and other electronic devices. But 
rather than entering alphanumeric text to identify a particular user, a gestural 
password is a movement pattern (e.g., circle, figure 8, spiral, square, etc.) that is 

20 entered using motion detection device 20. An appropriate prompt may be 

provided on display 14 to indicate that the user is to enter a gestural password. 
In one embodiment, a user's gestural password is stored in portable electronic 
device 10, and operation of the device 10 is enabled only after the user moves 
portable electronic device 10 (and correspondingly motion detection device 20) 

25 in a pattern that matches the stored gestural password. 

Figure 2 shows a simphfied representation of a side view of a motion 
detection device 20 suitable for tracking the relative movement of a work surface 
or an imaging surface, such as human finger 22, which is pressed against a 
surface 105 of a transparent stud 103. Although motion detection device 20 is 

30 described in the context of a human finger 22 as the imaging surface, it will be 
understood that motion detection device can be used on any suitable imaging 
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surface, such as a desktop, a wall, a pants leg, or any other surface that is 
relatively flat and conveniently available to the user of the portable electronic 
device 1 0. A motion detection device like that shown in Figure 2 is described in 
detail in U.S. Patent No. 6,057,540 (the '540 patent), which is incorporated by 
5 reference. The operation of motion detection device 20 is also summarized 
below. 

A light source 102, which is an LED in one embodiment, emits light that 
is gathered and focused by lens 104 to illuminate surface 105. Surface 105 may 
be flat, or preferably, have a slight curvature. Curvature aids in enlarging the 

10 size of the region of surface 105 that is in focus for the motion detector 1 09 
described below. Surface 105 may be a glass or other wear resistant coating 
applied to the end of transparent stud 103. In one form of the present invention, 
surface 105 is about 3/16 to 1/4 of an inch in diameter, and the length of 
transparent stud 103 ranges from about 3/8 to 3/4 of an inch. Another term that 

15 is descriptive of transparent stud 103 is "rod lens". Opaque barrier 110 keeps 
stray light from LED 102 from reaching motion detector 109. 

When the tip 106 of finger 22 is pressed against surface 105, the ridges of 
skin and any other micro texture features are visible in the plane of surface 105, 
just as if they were a part of surface 105. Lens 108 focuses light from those 

20 features onto an array of photo detectors, which is part of movement sensor 109. 
Movement sensor 1 09 automatically acquires and fracks any suitable image. 
When tracking an image, movement sensor 109 produces incremental (X, Y) 
signals. 

Lifting fingertip 106 away from surface 105 by even a few thousandths 
25 of an inch defocuses the image and produces a loss of tracking. This condition is 
detected within motion detector 1 09, and in one embodiment, the production of 
incremental (X, Y) signals ceases. This has the effect of leaving highlight bar 16 
unchanged at whatever location it currently occupies, and is exactly the same as 
when a user of a mouse removes his hand from the mouse. When fingertip 1 06 
30 is subsequently replaced on surface 105, motion detector 109 appreciates that an 
image has been acquired, and, in one embodiment, treats that acquisition as 
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though a reset has been performed. That is, until there has been new motion 
subsequent to the new acquisition, the incremental coordinates (X, Y) will have 
the value (0, 0). This leaves the existing position of highlight bar 16 undisturbed 
until such time as it is deliberately moved by the motion of fingertip 106, and 
5 corresponds exactly to a mouse user's placement of his hand back on the mouse 
without moving it. 

Motion sensor 1 09 uses exactly or substantially the same technique as the 
imaging and navigation arrangement described in the incorporated Patents. In 
the particular operational settings described therein, it was desirable that there be 

10 some magnification of the image before it reached the sensor, because of the 
small size of the micro-features being imaged and tracked (e.g., paper fibers). 
Here, the features on fingertip 106 are really quite large in comparison, so that 
magnification is not used in one embodiment. In alternative embodiments, 
magnification is used. Even though one form of an imaging and navigation 

15 mechanism is described in the incorporated Patents, a brief overview of the 
technique is provided below. 

An LED 1 02, which is an IR LED in one embodiment, emits light that is 
projected by lens 104 onto a region 105 that is part of a work surface 1 06 to be 
imaged for navigation. In one form of the present invention, motion sensor 1 09 

20 is an integrated circuit (IC) having an array of photo detectors, memory, and 
arithmetic circuits arranged to implement image correlation and tracking 
functions described herein and in the incorporated patents. An image of the 
illuminated region 106 is projected through an optical window (which may be 
transparent stud 3 itself) to a package (not shown) of integrated circuit 1 09 and 

25 onto the array of photo detectors. Lens 108 aids in the projection of the image 
onto the photo detectors. 

One preferred optical navigation technique according to the present 
invention optically detects motion by directly imaging as an array of pixels the 
various particular optical features visible at surface 105, much as human vision 

30 is believed to do. IR light reflected from a textured work surface pressed against 
surface 105 is focused onto a suitable array (e.g., 16x16 or 24x24) of photo 
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detectors. The responses of the individual photo detectors are digitized to a 
suitable resolution (e.g., six or eight bits) and stored as a frame into 
corresponding locations within an array of memory. In one embodiment, each 
pixel in a frame corresponds to one of the photo detectors. 
5 The overall size of the array of photo detectors is preferably large enough 

to receive an image having several features (e.g., ridges in the whorls of skin). 
In this way, images of such spatial features produce translated patterns of pixel 
information as fingertip 106 moves. The number of photo detectors in the array 
and the frame rate at which their contents are digitized and captured cooperate to 
10 influence how fast fingertip 106 can be moved over surface 105 and still be 

tracked. Tracking is accomplished by comparing a newly captured sample frame 
with a previously captured reference frame to ascertain the direction and amount 
of movement. 

In one embodiment, the entire content of one of the frames is shifted by a 

1 5 distance of one pixel successively in each of the eight directions allowed by a 
one pixel offset trial shift (one over, one over and one down, one down, one up, 
one up and one over, one over in the other direction, etc.). That adds up to eight 
trials. Also, since there might not have been any motion, a ninth trial "null shift" 
is also used. After each trial shift, those portions of the frames that overlap each 

20 other are subtracted on a pixel by pixel basis, and the resulting differences are 
preferably squared and then summed to form a measure of similarity 
(correlation) within that region of overlap. Larger trial shifts are possible, of 
course (e.g., two over and one down), but at some point the attendant complexity 
ruins the advantage, and it is preferable to simply have a sufficiently high frame 

25 rate with small trial shifts. The trial shift with the least difference (greatest 

correlation) can be taken as an indication of the motion between the two frames. 
That is, it provides raw movement information that may be scaled and or 
accumulated to provide highlight bar movement information (AX and AY) of a 
convenient granularity and at a suitable rate of information exchange. 

30 Sensor 109 automatically detects when fingertip 106 has been removed 

from surface 105, by sensing that all or a majority of the pixels in the image have 
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"gone dark." The process is actually somewhat more complicated than that, as 
explained below. 

When fingertip 106 is removed from surface 105, the IR light from the 
illuminating LED 102 no longer reaches the photo detectors in the same quantity 
5 that it did previously, if at all; the reflecting surface is too far away or is simply 
not in view. However, if fingertip 106 is removed and the surface 105 is 
exposed to an intensely lit environment as a result, then the outputs of the photo 
detectors might be at any level. The key is that the outputs of the photo detectors 
will be uniform, or nearly so. The main reason that the outputs become uniform 
10 is that there is no longer a focused image. All of the image features are indistinct 

and they are each spread out over the entire collection of photo detectors. 
Therefore, the photo detectors uniformly come to some average level. This is in 
distinct contrast with the case when there is a focused image. In the focused 
case, the correlations between frames (recall the one over, one over and one 

1 5 down, etc.) exhibit a distinct phenomenon. 

In operation, images should be acquired at a rate sufficient that 
successive images differ in distance by no more that perhaps a quarter of the 
width of the array, or 4 pixels for a 16x16 array of photo sensors. Experiments 
show that a finger speed of 50 mm/sec is not unreasonable. With 1 : 1 imaging, 

20 this corresponds to a speed at the array of 800 pixels per second. To meet a 

requirement of not moving more than four pixels per cycle, a measurement rate 
of 200 samples per second is needed. This rate is quite practical, and it may be 
desirable to operate at several times this rate. 

Figure 3 is an electrical block diagram illustrating the major components 

25 of a portable elecfronic device 10, such as cellular telephone lOA or lOB. 

Portable elecfronic device 10 includes antenna 196, communications circuitry 
198, motion sensor 109, display 14, input/output (I/O) interface 200, I/O interface 
202, keypad 24, processor 204, and memory 206. Motion sensor 109, display 
14, and keypad 24 are each coupled to I/O interface 202. FO interface 202 is also 

30 coupled to processor 204. Processor 204 communicates with motion sensor 109, 
display 14, and keypad 24, via I/O interface 202. Processor 204 is also coupled 
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to memory 206. In one embodiment, driver 208 is stored in memory 206. 
Processor 204 uses driver 208 to control highlight bar 16 on display 14 based on 
movement data received from motion sensor 109. 

Communications are sent and received by device 10 via antenna 196. 
5 Antenna 196 is coupled to communications circuitry 198. Communications 

circuitry 198 includes standard communications components known to those of 
ordinary skill in the art, such as amplifiers, analog-to-digital converters, digital- 
to-analog converters, modulators, and demodulators. Processor 204 is coupled 
to communications circuitry 198 via I/O interface 200. 

10 In one form of the present invention, processor 204 receives incremental 

(X, Y) signals from motion sensor 1 09, indicating relative movement between 
motion detection device 20 and a work surface. Using driver 208, processor 204 
processes the received incremental (X, Y) signals, and takes appropriate action. 
Using cellular telephone 1 OA as an example, if finger 22 is moved upward 

15 against motion detection device 20, processor 204 receives incremental (X, Y) 
signals from motion sensor 109 indicative of this upward movement. In 
response, processor 204 causes highlight bar 16 on display 14 to move upward 
through menu items 1 8A-1 8C. If finger 22 is moved downward against motion 
detection device 20, processor 204 receives incremental (X, Y) signals from 

20 motion sensor 109 indicative of this downward movement. In response, 

processor 204 causes highlight bar 16 on display 14 to move downward through 
menu items 1 8A-1 SC. If the received incremental (X, Y) signals from motion 
sensor 1 09 indicate leftward or rightward movement of finger 22 against motion 
detection device 20, processor 204 causes communications circuitry 198 to dial 

25 the phone number associated with the currently highlighted menu item. In one 
embodiment, processor 204 distinguishes between relatively small leftward or 
rightward movements, which may occur when a user is scrolling upward or 
downward through menu items, and larger leftward or rightward movements, 
which indicate that the user desires to select a highlighted menu item. 

30 In one form of the present invention, portable elecfronic device 1 0 

includes a security feature that requires a user to enter a "gestural password" 
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before using the device 1 0. To use this security feature, a user enters a 
movement pattern representing the user's password using motion detection 
device 20. Movement pattern data representing the entered movement is stored 
in memory 206. In one form of the invention, after a gestural password has been 
5 entered by a user and stored in memory 206, operation of device 10 is enabled 
only after the user moves portable electronic device 10 (and correspondingly 
motion detection device 20) against a work surface in a pattern that matches the 
stored gestural password. Processor 204 compares entered gestural passwords 
with movement pattern data stored in memory 206, and determines whether the 

10 movements match. In one embodiment, processor 204 uses conventional pattern 
matching techniques to identify whether the movements match. 

A user may be required to enter the user' s gestural password when device 
10 is first powered on, prior to each use of device 10, or other timing may be 
used. This security feature of device 10 prevents operation of device 10 if it is 

1 5 lost or stolen. In addition, the security feature may be used to identify multiple 
users of a particular portable electronic device 1 0, for billing purposes or other 
reasons. For example, multiple gestural passwords associated with multiple 
users may be stored in device 1 0. Each user would be required to enter the 
user's gestural password prior to operating device 10. 

20 In one form of the present invention, a user may enter free hand drawings 

into portable electronic device 10 by moving device 10 (and correspondingly 
motion detection device 20) against a work surface, or by moving finger 22 
against motion detection device 20. Entered drawings may be used to annotate 
or create facsimile documents, or may represent user signatures that may be used 

25 to verify electronic transactions. 

It will be understood by a person of ordinary skill in the art that functions 
performed by portable electronic device 10 may be implemented in hardware, 
sofl:ware, firmware, or any combination thereof. The implementation may be via 
a microprocessor, programmable logic device, or state machine. Components of 

30 the present invention may reside in software on one or more computer-readable 
mediums. The term computer-readable medium as used herein is defined to 
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include any kind of memory, volatile or non- volatile, such as floppy disks, hard 
disks, CD-ROMs, flash memory, read-only memory (ROM), and random access 
memory. 

Although specific embodiments have been illustrated and described 
5 herein for purposes of description of the preferred embodiment, it will be 

appreciated by those of ordinary skill in the art that a wide variety of alternate 
and/or equivalent implementations may be substituted for the specific 
embodiments shown and described without departing fi-om the scope of the 
present invention. Those with skill in the chemical, mechanical, electro- 
10 mechanical, electrical, and computer arts will readily appreciate that the present 
invention may be implemented in a very wide variety of embodiments. This 
application is intended to cover any adaptations or variations of the preferred 
embodiments discussed herein. Therefore, it is manifestly intended that this 
invention be limited only by the claims and the equivalents thereof. 
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